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In the Specification 

Please amend the paragraph beginning at line 9 of page 3 as follows: 



-The density evolution method is simple for a binary erasure channel. A binary 
erasure channel is a binary input channel with three output symbols: 0, 1, and an 
erasure, which can be represented by a question mark "?." Because this method is 
important background information for the method according to the invention, it is 
distinguished in greater detail.— 



Please amend the paragraph beginning at line 20 of page 5 as follows: 



0 



-Similarly, there is a message m ai sent from each check node a to all the variable 
nodes / connected to the check node. These messages are interpreted as directives 
from the check node a to the variable node / about what state the variable node 
should be in. This message is based on the states of the other variable nodes 
connected to the check node. The check to bit check-to-variable messages can, in 
principle, take on the values 0, 1, or ?, but again only the two messages 0 and ? are 
relevant when the all-zeros codeword is transmitted.— 

Please amend the paragraph beginning at line 4 of page 7 as follows: 

--The^equation for p ia is 

p>=xHv»> (3) 

beN(i)\a 

where b e N(i)\a represents all check nodes directly connected to a neighboring 
variable node i, except for check node a. This equation can be derived from the 
fact that for a message m ia to be an erasure, the variable node / must be erased in 
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transmission, and all incoming messages from other checks check nodes are 
erasures as well. Of course, if the incoming messages are correlated, then this 
equation is not correct. However, in a Tanner graph with no loops, each incoming 
message is independent of all other messages.— 




Please amend the paragraph beginning at line 14 of page 7 as follows: 



-Similarly, the equation 



(4) 



jeN(a)\i 



can be derived from the fact that a message message can only be in a 0 or 1 
state when all incoming messages are in either a zero or one state. — 




Please amend the paragraph beginning at line 19 of page 7 as follows: 



—The density evolution equations (3) and (4) can bfe ,solved by iteration. A good 
initialization is p ia = x for all messages from variable nodes to check nodes and 
q ai = 0 for all messages from check nodes to variable nodes, as long as the iteration 
begins with the q m message s messages . The BEC density evolution equations 
ultimately converge. This can be guaranteed for codes defined in graphs without 
loops. It is possible to determine b b which is the probability of a failure to decode 
at variable node /, from the formula 

aeN(i) 
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Please amend^theparagraph beginning at line 1 of page 9 as follows: 
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—If the focus is on the last bit, then the message is decoded, unless one of the 
following messages is sent: 00??, 0???, ?0??, ??0? or ????. Therefore, the overall 
probability that the fourth bit is not decoded is x 2 (\ - xf + 3jc 3 (1 - x) + x 4 = x 2 + jc 3 - 
x 4 . In the density evolution method, the values for the following variables: 

Pll , Pl\ , P22 , P32 , PM , qil , q\2, <]22, <723, #24, b\, b 2 , 63, 64 

are determined by equations 



and 



Pu = x (7) 

P»=xq 22 (8) 

Pn=xq n (9) 

Pn=* (10) 

P n =xqu=pu (44 4(1 la) 

fri =Pi\ 01b) 

q» = Pn (12) 

q 12 =\-{\-p n ){\-p A2 ) (13) 

q 23 =\ -(\-p 22 )(\-pJ (14) 

q u-\ (\p^ -p4^ g 24 =l -((l-p 32 )(l-/> 22 )) (15) 

b,=xq n (16) 

b 2 =xq u q 22 (17) 

b 3 =xq 13 (18) 

b 4 =xq M . (19)- 
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Please amend the paragraph beginning at line 22 of page 10 as follows: 



—If all local neighborhoods in the Tanner graph are identical, the density evolution 
equations can be simplified. For example, if each variable node i is connected to d v 
parity checks check nodes , and each check node a is connected to d c variable 
nodes, then all the p ia are equal to the same value /?, all the q ai are equal to the same 
value q, and all the b t are equal to the same value b. Then, 

p = xq dv ~ l (34) 

tf = 1-0 -/O''" 1 (35) 

and 

b = xq d * (36) 
which are the density evolution equations for (d v , d c ) regular Gallager codes, valid 
in the N -» oo limit. A regular Gallager code is a sparse random parity check 
matrix characterized by the restriction that each row has exactly d c ones in it, and 
each column contains exactly d v ones.— 

Please amend the paragraph beginning at line 22 of page ¥r \ as follows: 



-The basis of our RG method is the RG transformation by which we iteratively 
eliminate , i.e., "renormalize," single nodes in the decorated Tanner graph, and 
adjust the remaining values of the p and q messages so that the smaller error- 
correcting code has a decoding failure rate as close as possible to the replaced 
code.~ 
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Please amend the paragraph beginning at line 4 of page 17 as follows: 

-Otherwise, if there are no "leaf 5 check nodes check nodes, renormalize 940 a 
variable node from among those farthest from the target node that is directly 
connected to the fewest number of check nodes. Again, ties can be broken 
randomly. 



Please amend the paragraph beginning at line 1 of page 1 8 as follows: 



—We always initialize our decorated Tanner graph such that all b^-^e h=x + p ia = 
x, and all q ai = 0. We are interested in the decoding failure rate b t at the specified 
target variable node i. Our method 900 obtains Z>, by repeatedly renormalizing 
nodes, one node at the time, as described above, other than the target variable node 
i itself.— 

Please amend the paragraph beginning at line 7 of page 1 8 as follows: 



—The first possibility is to renormalize the farthest renormalize a "leaf variable 
node node / that is connected to the target node i check node a . Clearly, when that 
leaf variable node "vanishes," /? /a and q ai are also discarded. We also renormalize 
all the q a j variables leading out of the target node i check node a to other variable 
nodes j. Our formulation for this renormalization is: 

^<-l-(l-^)(l-A a ) (37) 
where the left arrow indicates that we replace the old value of q aj with the new 
value. Notice that each renormalization of q aj increases its value. — 
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Please amend the paragraph beginning at line 15 of page 18 as follows: 



—When we renormalize a "leaf check node a that is only connected to a single 
variable node, we adjust the values of all the p& variables leading to other checks 
nodes b to which the target node i variable node i is attached. The renormalization 
group transformation is 

Pib <- Pitfai " 

Please am6ncfthe paragraph beginning at line 25 of page 18 as follows: 



—The renormalization of step 940 is described in greater detail below for loopy 
graph s graphs with loops .— 



Please amend the paragraph beginning at line 1 of page 19 as follows: 



1 

—When only the "target" node i remains, we use the current value of node Z>, as our 

Ai l\ RG prediction of the average failure rate. As stated above, these steps can be 

^ repeated for any number of target nodes.— 




Please amend the paragraph beginning at line 1 3 of page 1 9 as follows: 

\ \ 

\ — i . — . . 






--We desire to determine the decoding failure rate at the second variable node b 2 . 
We initialize &^ u -^xr=-Pix=-P4*=^x p,, ~ p.n.^p?? -p^~p^ ~ x, q,, ~ q n ~ 
a 7? = q?i = q?4 = 0, and feM) b, = b? = bi = bs= x.- 
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Please amend the paragraph beginning at line 19 of page 20 as follows: 



-For an error-correcting code represented by a graph with loops, we eventually 
have to renormalize 940 a variable node that is not a "leaf node. Note that we 
never have to renormalize a non-leaf check node. To do this, we first collect all the 
check nodes a, 6, etc. connected to the target node L We discard q ah qbhPia,Pib, etc. 
For any given check node attached to variable node i 9 e.g., check node a, we also 
collect all the other variable nodes j attached to node a, and renormalize the values 
of q aJ .- 



Please amend the paragraph beginning at line 18 of page 22 as follows: 

—Converting such a logical argument into an equation for probabilities is 
straightforward. If we have "wij and m 2 " for two independent messages in a logical 
argument, then we translates these terms to (p { p 2 ) for the corresponding 
probabilities, while "mi or m 2 " translates to (1 - (1- p\) (1 - p 2 )). Converting our 
full logical argument for Figure 4 into an equation for probabilities, enables us to 
recover an example of the RG transformation of equation (44).- 

— — — — m * ; 

Please amend the paragraph beginning at line 8 of page 25 as follows: 

-For the purposes of describing the exact determination, we instead represent the 
error-correcting code by a Tanner graph of N nodes, and an associated an e rasur e 
erasure probability x, with each node i of the graph. This "erasure graph" is 
different than the decorated Tanner graphs 301-305 described above. The decoding 
failure rate can be determined exactly for an erasure graph, but the exact 
computation is only practical if the number of nodes in the erasure probability 
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graph is small. We describe how to determine the decoding failure rate exactly for 
an erasure probability graph, and then describe how to convert a decorated graph 
according to the invention into an equivalent erasure graph. -- 


■'7 

Please amend the paragraph beginning at line 24 of page 29 as follows: 




-The messages m ia are log-likelihood ratios by which the variable node i informs 
the check node a of its probability of being either a zero or a one. For example, 
wi/fl -> 00 means that node i is certain it is a zero, while m ia = 1 means that variable 
node / is signaling check node a that ln(p(x/ = 0)//?(x/ = 1)) = 1 . The messages ^ 
messages m n i are log-likelihood ratios interpreted as information from the check 
node a to the variable node i about the state of variable node /. 


Please amend the paragraph beginning at line 12 of page 30 as follows: 


" ?f- , 

—In the density evolution method for the AWGN, channel, one considers the 

probability distributions p(m ia ) and^,**,-) p(m ni 2 for the messages where the 
/) r\A probability distribution is an average over all possible received blocks. A 
(jl U distribution^*) is called consistent if fix) = f-x)z x for all x. The consistency 

condition is preserved for the message probability distributions for all messages 

under sum-product decoding. — 


" ~ r ^— 

Please amend the paragraph beginning at line 19 of page 30 as follows: 




—If the probability distributions p(m ia ) and p{m ai ) are approximated as Gaussian 
distributions, then the consistency condition means the means |n means that the 
means, \i, of these distributions are related to the variances a bv a =2ju. This 
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means that the message probability distributions can be characterized by a single 
parameter: their mean.— 



Please amend the paragraph beginning at line 21 of page 31 as follows: 

--Just as before, we construct a set of RG transformations which exactly reproduce 
the density evolution equations for a tree-like graph. We generate a decorated 
Tanner/Wiberg graph for the code by keeping u ai and v ia variables between each 
pair of connected nodes. The u ai variables are initialized to infinity, while the v ia 
variables are initialized to u°, unless the ith. node is a hidden node, in which case 
the Via are initialized to zero. We also introduce the variables h f variables hi 
analogous to b ( in the BEC, which are initialized like the v ia variables.-- 

Please amend the paragraph beginning at line 1 9 of page 34 as follows: 



—On the other hand, determining the bit error rate of every node slows down a 
search. It may be worthwhile, at least at least for large block-lengths, to restrict 
oneself to those codes for which there are only a small number of different classes 
of nodes, defined in terms of the local neighborhoods of the nodes. Most of the 
best-known codes are of this type. Rather than determining the bit error rate for 
every variable node, we can determine the bit error rate for just one representative 
node of each class of variable nodes.— 
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